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The synchronization adjusting unit 14 receives the pro- language processing means for receiving language texts 
cessing results from the prosody processing unit 13, and of the distributed multi-media information, transform- 
adjusts the time durations for every phoneme to synchronize i n g the language texts into phoneme strings, and esti- 
the image signal by using the synchronization information mating and symbolizing prosodic information from the 
which was received from the multi-media distributor 11. 5 language texts; 
With the adjustment of the time duration of phonemes, the " ] . . 
Up shape can be allocated to each phoneme in accordance P^o&y processing means for receiving the prosodic 
with the position and manner of articulation for each information from said language processing means, and 
phoneme, and the series of phonemes is divided into small calculating values of prosodic control parameters; 
groups corresponding to the number of the lip shapes io synchronization adjusting means for receiving the pro- 
recorded in the synchronization information by comparing S odic control parameters from said prosody processing 
the lip shape allocated to each phoneme with the lip shape means, adjusting time durations for every phoneme for 
in the synchronization information. synchronization with the image information by using 
The time durations of the phonemes in each small group synchronization information of the distributed multi- 
are calculated again by using information on the time 15 media information, and inserting adjusted time dura- 
durations of the lip shapes which is included in the synchro- tions into the prosodic control parameters; 
nization information. The adjusted time duration informa- g . . processing raeans for reC eiving the processing 
tion is made to be included in the results of the prosody from ^ s tollization adjusting mea ns and 
^ un£ 15 m8UIUt 13 ' andlStranSfOTedt0 ^stgnalproccssing ^ generating a synth ' esi2ed speech; and 

S UD ^he signal processing unit 15 receives the processing a s J nthesis k unit ******* * lock for ^selectmg required unit, 

*f . * J_ u • *• a- %a for synthesis in accordance with a request from said 

r-i results from the synchronization adjusting unit 14, and . ; . , . / , . . 

rl generates a synthesized speech by using the synthesis unit signal processing means, and transmitting the required 

m DB 16 to output it. The synthesis unit DB 16 selects the <&Xa to said signal processing means. 

83 synthesis units required for synthesis in accordance with the 25 2. The system according to claim 1, wherein the multi- 

M= request from the signal processing unit 15, and transfers media information comprises: 

\fi required data to the signal processing unit 15. the language texts, image information on moving picture, 

I . I In accordance with the present invention, a synthesized and synchronization information, 

speech can be synchronized with moving picture by using 3Q ^ wherein the synchronization information includes: 

5 the method wherein the real speech data and the shape of a a text information on a lip shape, information on image 

M= lip in the moving picture are analyzed, and information on positions in the moving picture, and information on 

Q the estimated lip shape and text information are directly used t ^ mt durations. 

y, in generating the synthesized speech. Accordingly, the dub- 3 The $ystem according t0 claim 2 . wherein the infor- 

' bing of target language can be performed onto movies in 35 Qn ^ ^ $h ^ be tmg[amiBd mto nume rical 

~ forei g n languages. Further, the present invention can be used ^ Qn a e of fl dowQ motion of a ^ u 

U ^ various apphcations such as a 5^ l »^ n s ^ U p and down motion at a left edge of an upper lip. up and 

La office automation, education, etc. since the synchronization / . f 5J f r , , tm 

r~* c . . £ . . „ e . . J . > Ua down motion at a right edge of the upper lip. up and down 

of image information with the TTS is made possible in the . , ,. AA 

. t: * A - ^ nx7 : r ^^ n t motion at a left edge of the lower lip. up and down motion 

multi-meaia environment ^ . . , _ , T . 

m . , „ , . . , w at a nght edge of the lower lip, up and down motion at a 

The present invention has been described with reference & . - . , • . . 

me pi^a^ui mvtiiiiuu uoo u center portion of the upper lip, up and down motion at a 

to a particular embodiment in connection with a particular *~ ™~ / rtff u 0 

apphcation. Those having ordinary skill in the art and access center portion of the lower lip, a degree of protrusion of the 

to the teachings of the present invention will recognize "PPer J* a de ^ e of protrusion of me lower hp, a distance 

additional modifications and applications within the scope 45 from the center of the lip to the nght edge of the hp and a 

fafxeef distance from the center of the hp to the left edge of the hp. 

It is therefore intended by the appended claims to cover and wherein the information on the hp shape is definable 

any and all such apphcations, modifications, and embodi- in a quantified and normalized pattern in accordance 

ments within the scope of the present invention. with the position and manner of articulation for each 

What is claimed is: 50 phoneme. 

1. A system for synchronization between a moving picture 4. The system according to claim 1, wherein said syn- 

and a text-to-speech converter, comprising: chronization adjusting means comprises means for calculat- 

distributing means for receiving multi-media input ing time durations of phonemes within a text by using the 

information, transforming said multi-media input infor- synchronization information in accordance with a predicted 

mation into respective data structures, and distributing 55 lip shape determined by a position and manner of articula- 

the respective data structures for further processing; tion for each phoneme within a text, a hp shape within the 

image output means for receiving image information of synchronization information, and time durations, 
the distributed multi-media information and displaying 

the image information; ***** 


